Fast and robust fixed-point algorithms for independent component analysis

نویسنده

  • Aapo Hyvärinen
چکیده

Independent component analysis (ICA) is a statistical method for transforming an observed multidimensional random vector into components that are statistically as independent from each other as possible. In this paper, we use a combination of two different approaches for linear ICA: Comon's information-theoretic approach and the projection pursuit approach. Using maximum entropy approximations of differential entropy, we introduce a family of new contrast (objective) functions for ICA. These contrast functions enable both the estimation of the whole decomposition by minimizing mutual information, and estimation of individual independent components as projection pursuit directions. The statistical properties of the estimators based on such contrast functions are analyzed under the assumption of the linear mixture model, and it is shown how to choose contrast functions that are robust and/or of minimum variance. Finally, we introduce simple fixed-point algorithms for practical optimization of the contrast functions. These algorithms optimize the contrast functions very fast and reliably.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A family of fixed-point algorithms for independent component analysis

Independent Component Analysis (ICA) is a statistical signal processing technique whose main applications are blind source separation, blind deconvolution, and feature extraction. Estimation of ICA is usually performed by optimizing a 'contrast' function based on higher-order cumulants. In this paper, it is shown how almost any error function can be used to construct a contrast function to perf...

متن کامل

New Fixed-point Ica Algorithms for Convolved Mixtures

One of the most powerful techniques applied to blind audio source separation is Independent Component Analysis (ICA). For the separation of audio sources recorded in a real environment, we need to model the mixing process as convolutional. Many methods have been introduced for separating convolved mixtures, the most successful of which require working in the frequency domain [1], [2], [3], [4]....

متن کامل

Fast Fixed-point Algorithms for Bayesian Blind Source Separation

In this paper, various fast algorithms for linear blind source separation (BSS) are developed. The fast xed-point algorithm for independent component analysis 8, 6] is interpreted as an EM-algorithm with a modiication for accelerating the convergence rate which can otherwise be slow particularly in a low noise environment. The new point of view opens way for developing several new fast xed-poin...

متن کامل

A Neural Network Algorithm based Blind source Separation using Fast Fixed Point Independent Component Analysis

Image separation is defined as decomposing a real world image mixture into individual images objects. Independent component analysis is an active area of research and is being utilized for its capability in statistically independent separation images. Neural network algorithm ICA has been used to extract interference and mixed images and a very rapid developed statistical method during last few...

متن کامل

A Neural Network Algorithm based Blind source Separation using Fast Fixed point

Image separation is defined as decomposing a real world image mixture into individual images objects. Independent component analysis is an active area of research and is being utilized for its capability in statistically independent separation images. Neural network algorithm ICA has been used to extract interference and mixed images and a very rapid developed statistical method during last few...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • IEEE transactions on neural networks

دوره 10 3  شماره 

صفحات  -

تاریخ انتشار 1999